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Scope and purpose—This paper develops a computer-implemented analytical model to serve as an 
evaluation tool for a new technology: automatic vehicle location (AVL) systems. AVL systems are 
currently being developed for use in a variety of urban services, including police, transportation, and postal. 
AVL cost is projected to range from $500 to over $10,000 per vehicle. Focusing primarily on police, the 
model builds on the “hypercube queuing model” reported earlier in this journal. The revised model allows 
for “AVL.” dispatching of police patrol units, meaning that the closest available unit is always dispatched to 
the scene of the indident. The model allows a detailed depiction of a city's geography and travel time 
characteristics as well as rather flexible procedures for deploying patro! units. Thus, using the model, a 
potential consumer, manufacturer or evaluator of an AVL system can estimate the effect of AVL on 
response times, inter-area dispatch frequencies, workloads, dispatch error probabilities, and other 
measures of system performance. 


Abstract—Automatic vehicle location (AVL) systems present to the dispatcher of emergency response units 
(e.g., police cars, ambulances) the estimated real time locations of units within his service area. Building on 
a recently developed hypercube queuing model, this paper presents a Markov process model for computing 
the operating characteristics of the radio-dispatched fleet operating under a policy that dispatches the 
closest available unit to each call for service (implying use of a perfect resolution AVL system). The model 
accommodates a realistic description of the service area and rather general spatial deployment policies for 
units. 

In implementing the model for efficient computer execution, the focus is on computation and storage 
minimizing procedures for generating the state-to-state Markov transition rates. One useful technique 
involves the effective application of a recently developed backward regenerative unit-step tour of the 
hypercube. The algorithmic procedures generalize to computer solutions of M/M/N queuing systems with 
distinguishable servers, different customer classes, and a cost structure for assigning servers (who may be 
in one of several “postures”) to customers of each class. 

The paper concludes with a realistic nine-unit police example that indicates the general ways in which 
AVL dispatching improves (and degrades) system performance. 


1. INTRODUCTION AND OVERVIEW 


In urban emergency service systems (e.g., police, fire, ambulance and emergency repair 
services), increased attention is being focused on various technological innovations for 
improving operational performance. Automatic vehicle location (AVL) systems comprise one 
important class of such innovations. These systems would present to the radio dispatcher the 
estimated locations of all emergency response units under his jurisdiction. Dispatch decisions 
could then be made with an awareness of these estimated locations, resulting in improved 
operations compared to standard manual dispatching procedures. 

This paper presents a method for modeling analytically one simple form of dispatching using 
AVL information. It is assumed that the exact, realtime locations of all response units are 
known (i.e., a perfect resolution AVL system) and that the dispatcher always dispatches the 
closest available response unit to an incident (closest vehicle dispatching). 
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The model builds on “the hypercube queuing model,” which is a spatially distributed 
queuing model developed recently to analyze analytically the performance of urban emergency 
services[1]. Various algorithms and theoretical concepts of the hypercube model are extended 
to incorporate in an efficient manner the more complicated dispatching mechanism presented by 
the AVL system. 

The hypercube implementation of the closest available vehicle strategy computes all of the 
standard hypercube performance measures: workloads of each of the units, mean travel times 
and cross-area dispatch frequencies. In addition, it computes new measures that relate 
specifically to AVL systems: point-specific dispatch error probabilities for any non-AVL (fixed 
preference) strategy and point-specific mean travel time reductions due to AVL. 

AVL systems are just now being implemented in U.S. cities. The St. Louis (Missouri) 
Metropolitan Police Department has allocated $2.7 million toward implementing a computer- 
assisted dead reckoning system, utilizing funding from the Law Enforcement Assistance 
Administration of the U.S. Department of Justice. [12] [14] This system became fully 
operational (city wide) in March 1977. Also in 1977 the City of Huntington Beach, California, 
implemented a fixed-post sensor system for use by its police department and (eventually) its 
other emergency services. Other police departments utilizing an AVL-system include those of 
Montclair, California; Stamford, Connecticut; and Dallas, Texas. Numerous other cities have 
expressed interest in AVL systems. Additional AVL test and implementation work is being 
supported by the U.S. Department of Transportation, using sites in Philadelphia, Pennsylvania 
and Los Angeles, California. 

Given the current attention directed toward AVL systems, it is especially important for 
potential users to have access to an inexpensive tool for evaluating the consequences of AVL 
in their own cities. For emergency services the hypercube model (with AVL dispatching) is 
intended to fulfill this need. It allows detailed examination of the projected “before and after” 
effects of closest unit dispatching, thereby facilitating an evaluation of AVL prior to purchase 
and implementation. This is especially critical due to the relatively large purchase price (and 
associated upkeep cost) of AVL systems, often amounting to millions of dollars per city. It is 
also important that the model includes details of a city’s geography, travel time characteristics, 
and spatial deployment patterns; the operational effects of AVL dispatching depend in a 
complicated way on each of these factors. The PL/I computer program which implements the 
model described herein is available (at cost) from the address contained in [13] (which is the 
user’s manual for the program). 

Prior to 1972, two AVL modeling efforts are noteworthy. The first was performed by M. 
Bellmore as part of the work of the Science and Technology Task Force of the President’s 
Commission on Law Enforcement and Administration of Justice(2]. Bellmore specified a 
probability p that any particular unit would be unavailable to respond to a call for service; 
higher levels for p indicate a patrol force with higher workloads. Units were determined to be 
available or busy by independent Bernoulli trials, with p being the busy probability. A square 
simulated region contained N regularly spaced square patrol beats, the length of each 
side being VN (assumed integer) beat lengths. Position estimation resolution of the AVL 
system was specified by a fraction I/r (r integer), such that for a given r each beat was 
partitioned into 7° square subbeats. The AVL system would specify the subbeat of the 
patrolling unit with certainty, but the location of the unit within the subbeat was assumed to be 
uniformly distributed. The dispatcher using the AVL system would always dispatch the vehicle 
estimated to be closest according to the right angle distance metric. This metric specifies that 
the distance between two points (x,, y,) and (x2, y2), assuming directions of travel are parallel to 
the coordinate axes, is d,2=|x,—x2|+|y1— y2|. In using the right angle distance metric, the 
unit’s position was “‘guesstimated” by the dispatcher (actually a computer subroutine) to be at 
the center of its subbeat. Bellmore’s analysis focused on travel time savings achievable with 
AVL as a function of workload p and resolution r. While a pioneering effort in the analysis of 
AVL systems, Bellmore’s model was limited in several areas: (1) the actual way that units 
become busy is not according to independent Bernoulli trials, and there is significant de- 
pendence among states of response units; (2) it is not apparent how to apply Bellmore’s ideas to 
realistic nonsymmetric situations, perhaps involving overlapping beats; (3) being a simulation 
model, it was impractical with Bellmore’s model to compute point-specific (as well as area- 
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averaged) performance measures; (4) the resolution model, in terms of subbeats, does not 
reflect the workings of any actual AVL system. 

The second effort by Bales[3] used most of Bellmore’s ideas but with a resolution model 
that was found realistic for most radio-trilaleration AVL systems. This modeled the position 
estimation error as a circularly symmetric Gaussian error, where the peak of the Gaussian 
distribution was located at the response unit’s location. 

In 1972 Larson devoted a chapter of his book to AVL systems (‘‘Evaluating Technological 
Innovations: Automatic Car Locator Systems” in [4]). The analysis included ‘“back-of-the- 
envelope” geometrical probability models of simple one- and two-dimensional situations and 
standard queuing models operating with AVL dispatching. It also included a simulation model, 
incorporating a circulatory symmetric Gaussian error characteristic, to depict realistic urban 
situations. 

Recent technological advances in AVL development have revealed systems whose resolu- 
tion is well within a fifth or less of a beat length. Bellmore’s and Bale’s work, as well as 
Larson’s work in 1972, indicated that systems with such good resolutions achieve response time 
reductions almost as great as perfect resolution systems. Thus, for modeling the operational 
impacts upon an emergency service system (most likely a police department) it is not 
unreasonable to assume a perfect resolution system. 

This is the approach taken with the hypercube model, namely a perfect resolution AVL 
system is assumed. The limitations of the earlier modeling work regarding the lack of 
independence of the states of response units, the adaptability to arbitrary (nonsymmetric, 
realistic) situations, and the computation of point-specific performance measures are overcome 
within the hypercube framework. Given this framework, one models the geography of a region 
as a set of discrete points called reporting areas or geographical atoms. A mobile response unit, 
typically a police car, can be located in any one of a subset of these points, called a district, 
with an arbitrary probability distribution over the atoms in the district. In police applications a 
district may in fact be called a beat or sector or route or area. Districts may overlap in arbitrary 
ways, reflecting rather complicated spatial deployment policies. An example with N =5 
response units with nonoverlapping districts is given in Fig. 1. Here a call for service arrives 
from an atom in the northeast quadrant of district 3, finding all five response units available at 


Successively larger 
dispatch radii 


{n) Denotes district n 

¢ Location of geographical atom 
@® Atom containing a response unit 
bd Atom containing incident 


Fig. 1. N = 5 Example in which the district unit is not the closest available unit. 
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the locations (atoms) indicated. A dispatcher operating under a non AVL dispatching strategy, 
would most likely dispatch unit 3 to the scene of the call for service. However, assuming right 
angle travel distances, unit 2 is found to be closest to the scene, followed by unit 1 and then unit 
3. Thus, with this configuration of units and this particular atom for the call for service, the 
AVL strategy implemented within the hypercube model would dispatch unit 2, yielding a 
substantial savings in travel time or distance. 

A non AVL strategy is usually described by a fixed vector of preferred units for each atom 
generating a call for service, and the dispatcher assigns the first available unit in the vector 
(starting with the most preferred unit, which most likely would have been the district 3 unit in 
this example). An AVL strategy is a matrix strategy, with an element in the matrix being the 
conditional probability that some unit n will be the ith preferred unit, given that all units are 
available for dispatching; if certain units are not available, then the conditional probabilities must 
be recomputed and scaled accordingly. Given a specified availability of units and a location for the 
call, if the non AVL strategy yields a dispatch decision different from the AVL strategy (that is, if it 
selects other than the closest available unit), then a dispatch error is said to occur. The hypercube 
model computes numerous performance measures for the system, including region-wide and 
point-specific dispatch error probabilities. This allows detailed analysis of any fixed preference 
(non AVL) strategy vs an AVL strategy. 

After briefly reviewing the relevant terminology of the hypercube model, the paper focuses 
on the efficient computation of state- and unit-dependent rates of transition to other system 
states. Exploiting and expanding certain ideas applied to earlier implementations of the 
hypercube model, an efficient procedure is found for computing the upward transition rates 
(i.e., those that determine frequencies of dispatch of each vehicle) without ever storing the 
usually huge dispatch probability matrix. Part of the procedure involves a unit-step tour of the 
hypercube vertices. The methods are illustrated with a simple computational example. 

Once the state-to-state transition rates are found, the hypercube model is “solved” in the 
usual way[1], where solution implies numerical computation of the steady state system 
probabilities. Then these probabilities are coupled with a second hypercube tour, detailed in 
Section 5, to compute system performance measures. A nine-unit example, first studied with a 
simulation model [4], is then analyzed in Section 6, Certain point-specific performance measures 
for the nine-unit example are available for the first time. A final discussion section indicates how 
the algorithmic procedures used here apply to a rather general class of queuing system. 

For convenience, a summary of frequently used symbols is given in Table 1. Those desiring 
additional background on AVM systems may wish to consult AVL [5] and [6]. 


2. BRIEF DESCRIPTION OF THE HYPERCUBE MODEL 


Before describing the method used to model AVL dispatching, we give a brief overview of 
the relevant hypercube terminology. A more detailed description is given in Ref. [1]. 

The hypercube model assumes a geographical region R which is quantized into J geographi- 
cal areas or atoms. Associated with each atom j (i<j <J) is the fraction of region-wide 


J 
workload f; generated from within the atom ( f= 1) Central to dispatching decisions, the 
jet 


variable 7; is the mean travel time from atom i to atom j. 

For the region R, there is a set of N response units to respond to calls for service from the 
atoms. While available, these response units can be mobile and their possible locations are 
given by the location matrix L = (l,;), where 1,; is the probability that response unit n is located 


J 
in atom j while available (> 1,j = 1 for all n). The set of possible locations per unit n (ie., 
j= 


those j for which /,; > 0) is called the unit’s district; note that in general, districts may overlap. 

From a queuing point of view we assume that customers (calls for service) are generated 
from within the region in a Poisson manner at a mean rate A per hr., with each atom j acting as 
an independent Poisson generator with mean rate Af, Given the arrival of a call for service, 
exactly one of the servers (response units) is dispatched to its location, assuming at least one 
server is available. For the case of a zero-line capacity queue, any call for service that arrives 
while all N response units are busy is either lost or serviced from outside the region or by 
special reserve units from within the region. For the case of an infinite line capacity queue, any 
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Table 1. Summary of frequently used symbols 


N Total number of response units 

J Total number of geographical atoms 

f Fraction of region-wide workload generated from atom j, j=1,2,..., J 

Ty Mean travel time from atom i to atom j, i,j =1,2,...,J 

he Probability that response unit n is located in atom j while available, n = 1,2,...,N;j=1,2,...,J 
A Average number of calls for service generated per hour from within the entire region of interest 
a! Average service time per call 

Cn Vertices of N-dimensional unit hypercube in the positive orthant 

B A vertex contained in Cy 


b,, The nth binary digit (from the right) in B, n =1,2,...,N 
w(B) Weight of vertex B(Lb,) 
v(B) Numerical value of vertex B 


di Hamming distance between two vertices B, and B; 

ii Infinitesimal mean rate at which transitions are made from state i to state j, given the system is in state i (i# j) 
A Matrix of infinitesimal transition rates (with A, = — >> Ay) 

jai 

Sy kth member of unit-step hypercube tour, k = 1,2,...,2% 
ty Mean time for unit 1 to travel to atom j, given unit n is available, n=1,2,...,.N;j=1,2,...,7 
Pn Workload of unit » (measured in fraction of time busy servicing calls), n=1,2,..., N 
Pnj Fraction of all dispatches that send unit 2 to atom j,n=1,2,...,N;j=1,2,...,J 


Priye  Prob{unit n is the closest available unit|call in atom j, state of the system is B,}, 2 =1,2,...,N;j=1,2,..., 
J; k=0,1,...,2%-1 

Qnrye  Prob{unit n is the closest available unit and is located in atom r|call in atom j, state of the system is B,}, = 1, 
2,..., Nonj=1,2,...,0:k=0,1,...,2%-1 

batik Expected travel time of unit n, given that call in atom j, state of the system is B,, and unit is dispatched, 
n=1,2,...,N;j=1,2,...,J;k=0,1,...,2%-1 

r(e) Atom number of eth closest atom to some specified atom, e= 1, 2,..., J 

A, Set of available units, given the state of the system is B,, k=0,1,...,2%-1 


call for service that arrives while all N response units are busy is entered at the end of a queue 
of calls that is depleted by any simple queuing discipline that ignores the incident’s location 
(e.g., first come, first served, random). The service time of any response unit for any call for 
service is assumed to have a negative exponential distribution with mean 1/y. (It is straight- 
forward to generalize the results to allow each server n to have its own mean service time 1/x,,. 
Moreover, recent computational experience with other service time distributions indicates a 
significant insensitivity of results of the model to the exact form of the service time 
distribution{7].) Since the service time is assumed to be independent of the identity of the 
server, the location of the customer, and the history of the system, variations in the service 
time that are due solely to variations in travel times are ignored (mean travel time being 
assumed to be an order of magnitude smaller than mean on-scene service time). 

A state of the system is denoted by an ordered set of N binary digits B = {by, by-1,..., Di}, 
where unit n is said to be busy if b, =1 and idle (or available) if b, =0. The weight of B, 
denoted w(B), is equal to 2 b,, the number of binary ‘“‘ones” in the set B. The numerical value 
associated with the set B is 


N 
v(B) = > b,2"". 


n=1 


To each set B = {by, by-i,..., b;} there corresponds a unique point or vertex (or state) in R™ 
with nth coordinate equal to b, (n =1,..., N). The set Cy of all 2" such vertices is the set of 
vertices of the N-dimensional unit hypercube in the positive orthant. 

Defining binary set operations in the usual way, the Hamming distance between two 
vertices B; and B; is the weight of the symmetric set difference 


dy = w([B; 0 Bi) U [Bi By). 


For example, two vertices that are unit Hamming distance apart differ in only one binary digit. 
The “upward” Hamming distance is defined to be 


ij = w(B; 2 B;) 
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and the “downward” distance 
dj; = w(B; N Bi), 
where 
dij = dj + dj. 


The state space of the zero-line capacity model is Cy, where each vertex (state) corresponds 
to a particular combination of response units busy and idle. This state space is augmented by an 
“infinite tail” for the infinite-line capacity case. Since the two models are governed by the same 
equations for unsaturated states (i.e., states with at least one available response unit), we will 
focus the development on just one of the models: the zero-line capacity model. The infinite-line 
capacity case requires modifications for dispatches from a queue identical to those described in 
[1]. 

The state transition matrix is A=(Aj,), where Aj; = infinitesimal mean rate at which 
transitions are made from state i to state j, given that the system is in state i; ij/=0, 1,..., 
2% —1, i#j, and Ay= — 2 Ai Here for convenience we index the states according to their 

ji 


numerical values, i.e., we select i so that v(B;)= i, i=0,1,...,2N-1. 


There are two classes of transitions on the hypercube: upward transitions that change a 
unit’s status from available to unavailable and downward transitions that do the reverse. For a 


given vertex B; = {by, by-1,..., 6:}, upward transitions can occur to all “adjacent” vertices B; 
for which dj = 1. If unit n is the unit whose status is changed (from idle to busy), then B; = {by, 
by-1,..+5 On -.-, 5)} and B; = {by, by-1,..., 1n,..., D1}. Downward transitions can occur to all 


adjacent vertices B; for which dj = 1. No transitions occur to vertices that are more than unit 
Hamming distance from B; since only one unit is assigned to each call. 

Since the service times are all distributed as negative exponential random variables with 
mean yz", the transition rate associated with each downward transition is equal to 4. Thus, for 
all (i, j) for which dj = 1 we have A, =. For convenience we set » = 1, thereby equating the 
unit of time to the mean service time. 

The upward transition rates depend in a complicated way on the region’s geography, the 
system state and (for AVL dispatching) the real-time locations of the available units. Following 
the earlier work with fixed preference dispatching strategies, we will develop a recursive 
method to generate the set of upward transition rates, first by fixing the geographical atom of 
the call, then by touring the hypercube in a unit-step fashion. The entire matrix is completed as 
soon as the hypercube has been toured once for every geographical atom. 

As argued in [1], the model is a finite-state continuous time Markov process whose 
steady-state probabilities are determined from the equations of detailed balance, 


Bj}A; + w(B;)] = P{Biy}Ay + P{B}, j=0,1,...,2%-1 1 
PBMA+ (B= SPUBMat SPB ) 


where P{B;}= Prob{system is occupying state j under steady-state conditions}, 


fa QN 
B;E Cy, j=0,1,...,2%-1; and aa {por 2% —1, 


To guarantee a probability distribution, we also require that the probabilities sum to one, i.e., 


2N-1 


> P{B}=1, (2) 


i=0 


a condition which makes any one of the balance equations redundant and therefore removable 
from the set of equations. 


3. COMPUTING THE UPWARD TRANSITION RATES FOR AN AVL STRATEGY 


As in the hypercube model with fixed preference dispatching, it is necessary to develop a 
time- and storage-efficient way of generating the upward transition rates. For each atom j 
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(1 sj <J) we shall tour the hypercube in a unit-step fashion, visiting in succession the states 
S,, S:,..., S.x. From one step to the next, the status of only one response unit changes, either 
from busy to idle or idle to busy. The procedure for generating the upward transition rates 
avoids the requirement of storing usually huge intermediate matrices. 

Unlike the model with fixed preference policies, the AVL model requires a particular 


unit-step tour to be traversed. This is the backward regenerative unit-step tour S,, So, ..., Sox 
derived in [1]. Thus any particular hypercube vertex has an associated B; such that i = v(B,), 
i=0, 1,2,...,2% —1, and an S, such that the vertex is the kth visited vertex in the unit-step 


backward regenerative unit-step tour, k= 1, 2,..., 2%. Note that S, = B,:s). To generate this 
tour for N units, one supposes that the tour for N —1 units is known, the tour for one unit 
being {0}, {1}. The first 2"~' entries in the larger tour are obtained simply by augmenting the 
entries in the smaller tour with a zero (“0”) in the Nth digit (from the right). The final 2%~' 
entries are obtained by augmenting the entries in the smaller tour with a one (‘‘1’’) in the Nth 
digit and reversing the order of the sequence. As an example, after carrying out this procedure 
twice, starting with the one-unit tour, we obtain the 3-digit tour: S,={0,0,0}= Bo, S,= 
{0, 0, I}= B,, S; = {0, 1, 1} = B;, S4 a {0, 1, 0}= B,, Ss = {l, 1,0}= Bs, S6= {l, 1, I}= B,, S,= 
{1, 0, 1}= Bs, Sg = {1, 0, 0} = By. 

We now focus on computing the upward transition rates. Note that in general any unit n can 
be dispatched to a call in atom j, provided it can possibly be closer than any other available 
unit(s). Such multiple-choice assignments from the same state to the same atom occur with 
fixed preference policies only in the case of ties in dispatch preferences. In order to compute 
incrementally each upward transition rate, we must narrow our focus to the particular atom 
containing the dispatched unit, thereby defining 


nak = Prob{unit n is the closest available unit and is located in atom alcall is in atom j 
and the state of the system is B,}. 


For all states in which there is at least one available unit, we must have a proper probability 
distribution: 


N J 
dD dnae=1 fHd...,J; k=0,1,...,2%-2, 


For k = 2" —1 we have B, ={1,1,..., 1}, implying that all units are busy; in that case calls are 
either lost or handled by a back-up service, and 


Qnalj2X —1) = 0 for all n, a, j. 


Since the hypercube upward transition rates are aggregated over possible unit locations, we 
must also define 


Pat = Prob{unit n is the closest available unit|call is in atom j and the state of the 
system is B,}. 


Clearly, 


J 
Prik = 24 nae ) 


Now, the upward transition rates Ay, are calculated as follows: The matrix A is initialized to 
zero. Then when the point of the tour is reached where the call is in atom j and the state of the 
system is B; = {by, by-,..., b;}, the transition rates to all the adjacent states B, ={by, by-1, 

.+5 b,,..., by} such that dj =1 and b,= 1+ b, will be incremented by Af;P,j The quantity 
Af,Pn is the component of the total upward transition rate out of state B; corresponding to calls 
from atom j that result in unit n becoming busy (transitioning to state B,). The incrementing is 
CAOR Vol. 5, No. 1-—B 


18 R. C. Larson and E. A. FRANCK 
given by 
Nx —Ax + Af iPatii - (4) 


In many cases P,\;=0 for some n and no operation is performed. 

We start the tour in state S; = By = {0, 0, ..., 0} implying that all N units are available for 
dispatch. Our initial focus is toward computing an then toward updating the computation as 
unit-step transitions are made from state to state. 

To generate the qnajx efficiently, we rank all atoms i for each unit n for which /,; >0, in 
order of increasing travel time to atom j. After doing this for all n, we merge the rankings into a 
global ranking, defining the eth entry in the global ranking to be the eth closest possible unit 
location to atom j. In the case of two or more units possibly occupying the same location or atom 
(implying overlapping districts) or in the case of two or more different atoms being the same travel 
time to atom j, the e-ordering is assigned arbitrarily and any resulting tie(s) will be broken by 
random choice. For the eth entry in the ranking, atom r(e) is the corresponding unit location and 
Inve) is the probability that unit n is in atom r(e) while available. 

The minimum ranking for unit 7 is 


Ly=,.. mine. 
MH fale: Inrie)>0} 
The maximum ranking is 
U,j=..maxe.. 
mM {alles tnr(ey>0} 


Thus, possible locations for unit m can range from the L,;’th entry in the table to the U,,’th 
entry. For the case of collectively exhaustive nonoverlapping districts, this range starts with the 
L,;'th closest atom to atom j and ends with the U,,’th closest atom to atom j. The L,,’s will 
provide a guide for ordering the response units for use in the backward regenerative unit-step 
tour of the hypercube vertices. 

Ignoring ties (for the moment), we compute qnajx by arguing as follows: 


Qna\jx = Prob{no available unit is closer than 7,4; to atom j}- 
Prob{unit n is in atom alunit n is not in any closer atom}. 


Setting a = r(e), the first term on the right hand side is simply 


N e-1 
ze = I= 2% Qmr(fyljk: (5) 


and the second term is 


Trey = Lnrcey! (1 -¥ lan) , (6) 


the denominator arising from the conditional information that unit n is not closer than atom 
r(e). Thus, the equation that is useful in iterative computations is 


Gnr(eyik = Pzelnr(e) = [1 7 » »> amc | nr(e) if (1 -> tent) | (7) 


Note that [5,e)need only be computed once for any atom j and P, is found simply by subtracting 
the total accumulated probability (through table entry e — 1) from one. 


Compaction ; 

Suppose, given full availability of units, that some unit n may be located in two or more 
consecutive atoms r(e), r(e +1), r(e+2),..., r(e+m). Then if only average travel time (rather 
than its distribution) is to be computed with the model, the m +1 entries in the e-ordered table 
can be replaced by one aggregate entry. Call the new “aggregate atom” r(e— m). Then the new 
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entry in the table is specified by 


etm etm 


lnr(e->m) = > Law Tr(e+m)j — Dy Treipjl aril Lnr(e-omy 
xe : ize 


This compacted entry remains applicable to all 2% system states, often yielding substantial 
savings in computation time. 


Ties 

Suppose in the process of computing gareyx iteratively » (y =2) units are found which 
could be tied for dispatch preference. In other words, up to 7 units could be equidistant from 
atom j, located either in the same atom i or in different atoms equidistant from atom j. In such a 
case the e ranking for the tied units can be assigned arbitrarily. Then, if one wishes to treat ties 
inexactly, they could be ignored by applying equation (7) directly, implying that a tie would be 
broken in the same (arbitrary) way-each time that it is incurred. 

If an exact treatment is desired, let e,- denote the ranking of the last untied unit location. 
Let the tied units be denoted by 5), 52,...,5,, corresponding to unit locations ranked e,- + 1, 
€,-+2,..., €,—+ 7. Then for some unit s; equation (7) is replaced with 


Osirlen—+idlik = Pz, Q(e,-, Si), 
where 


Q(e,-, si) = Prob{unit s; is dispatched|a possible tie among units 5), 52,..., 5, and no 
unit dispatched in any unit location ranked e,- or lower}. 


Allowing all possible combinations, we have 


Cc ic 1 ic Ic c 
Q(en-> Si) = [sprlen +i) I]. = [sar(en—+m)) +5 Evley—ti) p» [eerlen—+k) IT (I- Is .r(éq—+m)) pe ss 


mALK 
kAi 1 
+2 TD farestmr 


While this equation is tedious to compute for general 7, in practice one rarely incurs ties of 
order higher than two or three. 


Transitioning to adjacent states 

Suppose at some unit-step tour state S,_, we have computed Qnajjo(s,_1) for all n and a. For 
instance, at state Sp we would have computed qnajjo. Then we make a unit-step transition to an 
adjacent tour state S, = Bys,, Causing some unit m to change status. For notional simplicity 
let k= v(S,). Now for state B, we want to compute qnaix for all n and a, taking advantage of 
our previous computations wherever possible. 

If the smallest possible e ranking for unit m (Ime) >) is such that there is always an 
available unit n closer to atom j than unit m, then the change in status of unit m does not affect 
the other units and all the q,aj% remain unchanged from the previous tour state. On the other 
hand, if unit m could possibly be the closest to atom j, then some computations must be 
performed. Thus, letting sf, = set of available units in state B,, there are two cases: 


1. Lin > min Up 
{n Et} 
astm 
In this case all qnayx remain unchanged. 
2. Linj <= min Uj 


{nE sty} 
nem 


In this case all Gaeysj Such that e< Ly remain unchanged (since changing the status of unit m 


20 R. C. Larson and E. A. FRAnck 


has no effect for units located in atoms closer than the unit can be located). All dareya such that 
e= L,,j are recomputed applying equation (7). 


Reordering the response units 

In traversing the hypercube in a unit-step fashion, the amount of computation to be 
performed will depend in large part on the frequency with which we encounter case 1: 
Linj > tn. U, implying all the q,aj are unchanged from the last toured vertex. The more 


often we encounter this case, the less will be the computational effort. Examining the backward 
regenerative unit-step tour, and recalling that the state of unit n is specified by the nth binary 
digit from the right, we see that in a complete tour unit n changes status 2"~" times. Thus, by 
making binary digit n correspond to that unit m for which L,,, is the nth largest of the Lyy’s, we 
change the status most frequently of units distant from atom j (resulting in case 1 occuring 
much more frequently than would occur with an arbitrary ordering of response units). Thus, to 
summarize, we reorder the response units as follows: 


Unit 1 is that unit with largest Lj. 
Unit 2 is that unit with second largest L,,; 


Unit N is that unit with smallest L,, 


We now briefly analyze the efficiency of the combined procedure of performing the unit-step 
tour and reordering the response units when computing qnajx for a fixed j. Suppose, in the worst 
case, that one simply recomputed q,.\, exhaustively for each different system state B,. The 
number of different values for qnoix for fixed j and k is MAX U,y— MIN Lj +1. Since these 


values would have to be recomputed for each state, the total number of computations of qnaiz 
required per complete set of states would be bounded above by 


[MAX Urgj~MIN Ly + 112%, 


since there are 2" different states. If one does not count “zeroes” as computations, due to units 
that are busy (and thus cannot be dispatched), then a better approximation for the number of 
times Qnajx must be computed is 


(MAX Uy — MIN Ly + 1]2""', 


since each unit is available (nonbusy) at half of the vertices. If one also wishes to discount 
“zeroes” due to exceeding the smallest U,,; of the currently available units for a given state B,, 
then perhaps the best approximation of the number of computations of qna required per 
complete set of states is given by 


N 
NC,~ n >, Un — Lay + 2" (8) 


where this average range is used to reflect the fact that as soon as the range is exceeded for an 
available unit, all remaining qnais are zero. 

We now quote a formula from the Appendix for the number of computations of dra 
required using the backward regenerative unit step tour in combination with reordering the 
units according to Lyy To avoid excessive complexity, we allow no ties and require that the 
upper bounds be ranked in the same way as the lower bounds. So, given the reordering of units, 
we must have 

Ly < LenS < Ly 


Uny < Uw-ry< +++ < Uy, 
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Define the positive part of X as follows: 


_fX if X>0 
X= {5 if X<0 


Then the number of computations of q,.ia required (per tour) using the backward regenerative 
unit step tour with reordered units is 


N 


N N 
NQ.= > > Day = Ly # D2" + (Way Lng + 1). (9) 


a=m+ 


In applying (9) in practical situations (e.g., data describing the district of a police department of 
one large city) one usually experiences reductions in computational effort (compared to the 
average range formula given by equation 8) of at least 4-to-1 and sometimes up to 10-to-1. 

As a further remark on efficiency, it is noteworthy that the matrix dispatching strategy 
implied by AVL dispatching requires no more storage of dispatching information than is 
required for fixed preference dispatching; and this is (N + 1)2" nonzero matrix elements, as 
argued in (1]. The process of incrementing the (aggregated) upward transition rates during the 
hypercube tour, as the qe are computed, implies that neither dase nor P,yw need be stored 
after leaving state B,. This is indeed fortunate since qaaia could require an array of NJ?2" 
elements to store completely; for N = 10 units and J = 100 atoms, this is about 10° storage 
elements, far too many to make the procedure practical. 


4. ILLUSTRATIVE COMPUTATIONAL EXAMPLE 

To illustrate the procedures described in Section 3, we consider the simple N =3 unit, 
J = 16 atom example summarized in Table 2. Here the atom of the incident is fixed at j = 1. We 
wish to compute qaneyie aS Specified in equation (7). From Table 2, note that units have been 
numbered according to lower bounds L,,, with L3, = 1, Lz, =5, and L,, = 11; atoms have been 
ordered by the index e according to increasing travel times 1,,.). 

The procedure for computing Garey Starts in state By = {0, 0, 0}. Applying (7) for e = 1, 2, 3, 
4, it is apparent, due to no overlap with unit 2, that qsjey10 = Ise- Subtracting the sum of the 
probabilities from one at that point, we have P.5 = 1 — (0.25 + 0.133 + 0.167 + 0.200) = 0.25. Thus 
Garsyio = 0.25(0.364) = 0.091. Now Pog = 0.159, and thus qsne6y10 = 0.1590. 133/(1 — [0.75])) = 
0.085. Continuing this process yields qi-710 ~ 0.032 and qingyi0 = 0.042. But e = 8 = Uj), and thus 
computations are completed for state Bo. 


Table 2. Illustrative hypercube tour: N =3 units, J = 16 atoms, incident in atom j = 1 


atom By B, B, B, B, B, B, B, 
e r{e) tret Unite lanes 000 00! O11 010 HO tt 101 100 
Garieyio arte Wit Garieyi3 Garve m2 Farieniio Farce rs Gare nia 

1=L,, I 0.0 3 0.25 0.25 0.25 0.25 0.25 @ 

2 6 3.7 3 0.133 «0133 0133) 0.133 0.133 

3 5 48 3 0.167, 0.167 0.167. (0.167 0.167 

4 2 5.9 3 0.20 0.200 0.200 0.200 0.200 

S=L, 7 8.5 2 0.364 «60.091 6.091 @ 0.0 6.0 @0.364 = 0.364 
6 4 8.7 3 G133 0.085 0.085 0.133 0.133 : 

7 8 9.2 2 0.273 «0.032 40.032 0.0 0.0 0.273 = 0.273 
8= U;, 3 14.5 3 O17 Oy BU 

9 10 13.2 2 0.227 0.227. 6.227 
10= U,, 9 13.9 2 0.136 
W=L,, i 17.2 1 0.130 e@ e 0.130 @ e 
12 12 17.7 1 0.098 0.098 

B 13 20.2 1 0.043 0.043 
14 4 20.4 i 0.087 0.087 
15 1S 22.8 1 0.217 0.217 

16= U,, 16 26.4 1 0.435 0.435 

0 indicates the current -. Uy 


@ the lower bound of the unit whose status just changed. 
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We now undergo a transition to state B, = {0, 0, 1}, causing unit 1 to become busy. But unit 1 
had zero probability of being dispatched in state {0, 0,0} since L,, > U3), and thus all of the 
computations remain unchanged. Following the backward regenerative unit-step hypercube 
tour, we next undergo a transition to state B; = {0, 1, 1}, causing unit 2 to become busy. This 
requires (U3, — Lz, + 1), =8—5+1=4 values of qnrtey1x to be recomputed; the new computations 
are easy, since unit 3 is the only unit available. The next transition to state B = {0, 1, 0} requires no 
new computation since L,, > U3. The next transition is to state Bg = {1, 1, 0}, causing unit 3 to 
become busy. Then the only nonzero qnrey1k 8 AF G3r(ey1k Which equal the corresponding /3,e). The 
next transition to B7 causes all units to become busy and the probability qnrey1x is Zero for all n. 
(Recall that with a zero-line capacity system, calls that arrive when all N units are busy are lost or 
handled by some back-up service system.) The final two states Bs and B, require only that unit 2 be 
dispatched, thus completing our example. 


5. PERFORMANCE MEASURES 


Once the upward transition rates are generated, the steady state equations of balance are 
solved in the usual way[l1], yielding numerical values for the steady state probabilities P{B,}, 
k=0, 1, ..., 2“—1. These probabilities allow us to obtain numerical values for the per- 
formance measures of interest: region-wide: mean travel time, dispatch error probability, 
workload imbalance, and fraction of dispatches that are inter-district dispatches; response unit 
specific: workload (measured in fraction of time busy servicing calls), mean travel time, 
fraction of responses of each response unit that are interdistrict; district specific: fraction of 
responses into each district that are interdistrict, mean travel time; point specific: mean travel 
time, dispatch error probability, frequency of patrol passings (in the case of mobile police 
patrol), fraction of calls handled by response unit n, n=1, 2, ...,N. This mixture of 
performance measures allows one to focus simultaneously on several region-wide objectives 
while assuring that spatial inequities in the delivery of service are maintained at an acceptable 
minimum. The dispatch error probability in conjunction with mean travel times and interdistrict 
dispatch frequencies allows one to compare the advantages and disadvantages of AVL 
dispatching to any fixed preference policy; such a comparison would require two executions of 
the model—one for each policy. 


Individual workloads 
Knowledge of the P{B,}’s is sufficient to compute the workload p, of each unit n, 


Pn = > P{B}}. 


{i:b,=1} 


The unit-step tour has certain periodicity properties that make computation of the sum 
particularly easy [9]. 


Retouring the hypercube 

For the remaining performance measures it is necessary to reconstruct the ‘fine structure” 
on the hypercube, which requires @najx and its sum over a, Pn. Due to the enormous storage 
requirements implied by storing these quantities, the decision is made simply to retour the 
hypercube using the computed P{B,} at each step to generate many of the performance 
measures iteratively. The fact that two tours of the hypercube are made—one to set up the 
equations of balance and, after their solution, one to compute performance measures— 
intensifies our interest in assuring that the tour is structured efficiently. 


Unit-specific mean travel times 

With a fixed preference dispatching strategy, the mean travel time ¢,; for unit n to reach 
atom j can be determined simply by knowing the dispatching strategy, the mean travel time 
from atom i to atom j rj, and the time-average statistical locations L = (I,;) of the units while 
available within the region R. However, with AVL dispatching the mean travel time is a 
complicated function of the real-time location of all available response units, whose availabili- 
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ties are determined by the system state B,. Thus the mean travel times are computed iteratively 
in the second tour of the hypercube. 

We use gaa to compute the expected travel times, which depend on the location of the unit 
when dispatched. Define 


tai = Expected travel time for unit n, given the incident is in atom j, the state of the system is 
B,, and unit n is dispatched. 


Thus fy) is the expected travel time for unit 1 (conditioned on atom j and state B,), given that 
it is the closest available unit. Recalling that 7,; is the travel time from atom a to atom j, we 
have for all Py > 9, 


J 
tan 3 GeatfalPate 0 =1,2,...5N, (10) 
pa 


(If Paix = 0, then trig is undefined.) 

Now the travel time ¢,;, not conditioned on system state, is calculated as follows: For each 
state B, ={by, bn-1,..., 5, ..., bi} in the second hypercube tour such that b, = 0 and Pris > 0, 
ta is incremented by tnijePnizP{B,}. In other words, 


tye tay + tninP, nik {B,}. (11a) 


After the computations are completed for all states B, the result is scaled: 


taj — ty PripP{B,}. 
i ye iP {By} (11b) 


Inter-area dispatch frequencies 
For the remaining performance measures it is necessary to compute 


pn; = fraction of all dispatches that send unit n to atom j (= Pnj = 1) 
ny 
Following [1] and the arguments above for travel time, 


" » Praia P {Bi} 
.  $Be:ba=0} . 
Pnj 1— P{Ba) all n, j. (12) 


This too is computed iteratively at each hypercube vertex. 

Once p,; and t,; are computed for all (n, j), then one uses equations (14)-(20) given in [1] for 
additional performance measures involving interdistrict dispatch frequencies and mean travel 
times. 


Dispatch error probability 

One may wish to execute the hypercube model with a fixed preference dispatching policy in 
order to compute dispatch error probabilities. This requires the computation during the second 
hypercube tour of the state-dependent dispatch probabilities for both the fixed preference 
policy and the AVL policy. 

Define for any fixed preference policy 


P;{C’} = Prob{dispatching a response unit other than the closest available unit to atom j}. 
Nj = total number of response units that are judged optimal under fixed preference dispatching, 
given state B, and a call in atom j (this is the number of tied units). 
7m = the number of the mth optimal unit, where 7, = 1, 2,..., N and m=1, 2, ..., my 
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If mj > 1 it is assumed that the unit dispatched to atom j (given state B,) is to be chosen 
randomly from among the tied units 7, fo, ... 5 Trg 

Since (1—P,,;x) is the probability that some unit other than 7,, is the closest one to 
dispatch, given atom j and state B,, the unconditional dispatch error probability is given by 


Pici=z (I~ Pra) PAB (13) 
m=1,2.. 


=1,2,..., kj 


where P{B,} in this case refers to the hypercube model with fixed preference dispatch policy. 


Multiple values of system-wide workload 

When one desires to execute the hypercube model with several different values of system- 
wide average workload p=A/N (everything else remaining constant), a significant com- 
putational efficiency is experienced. This occurs for either AVL or fixed preference dispatching. 
The efficiency derives from the fact that, regardless of the different number of workload levels 
desired, only two tours of the hypercube are required. 

The first tour is again to set up the equations of balance. After they are solved for one value 
of p, they can be altered easily to adjust for the next level since all the upward transition rates 
(A, such that dj = 1) are changed by the same relative amount. The fine-grain state-dependent 
dispatching policies remain unchanged and thus there is no need to recompute the A,’s by 
touring the hypercube. The computed steady state probabilities must be stored for each 
different workload level for use in the second hypercube tour. 

The second tour is used just as before to compute iteratively most of the system per- 
formance measures. Now at each state the measures for each of the workload levels are 
updated, thereby eliminating the need for more than one additional tour of the hypercube. For 
large problems, however, there exists a tradeoff between execution time (implying only one 
additional hypercube tour) and storage (which can grow very large if the performance measures 
for all workload levels are computed—and stored—simultaneously). In anticipating large 
problems and limited memory computers, the current programmed version of the model allows 
the user to choose either option: (1) execute one (re) tour of the hypercube to compute 
performance measures for each workload level specified; (2) execute only one (re) tour of the 
hypercube, computing performance measures for all workload levels simultaneously. 


6. NINE-UNIT EXAMPLE 

In this section we apply AVL dispatching to the N = 9 unit square region shown in Fig. 2. 
Here each unit, when available, is equally likely to be located in one of 16 evenly spaced atoms 
defining its district. Calls for service are uniformly distributed over all 9 x 16 = 144 atoms. Calls 
that arrive when all nine units are busy are entered in a queue of calls that is depleted on a 
first-come, first-served basis. Travel times are directly proportional to right-angle distance. 

We wish to compare AVL with two popular methods of fixed preference dispatching: Strict 
Center of Mass (SCM) and Modified Center of Mass (MCM). A similar analysis was reported 
previously ([4], Chaps 6, 7) using a Monte Carlo simulation model. 

Suppose atom j is located at (x, y;). To specify the two fixed preference policies, we define 
the center of mass of unit n (xn°, Yn°), where 


J 
Xn = Dy bash 
1 
" i 
Yn = > Li 
& 
and the center of mass of calls in district n, 


= > f/f >> 


i 
j€district n j€district a 


r= > fivy/ > 


p 
jEdistrict n jédistrict n 
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Fig. 2. Nine-unit square region. 


Now, an SCM dispatching strategy derives its vector of fixed preferences for units for calls 
from atom j € district m by rank ordering according to travel distance from each unit’s center 
of mass to the call’s center of mass: 


Unit n is the ith preferred if |x,°— ,,|+|y,° — Ym| is the ith smallest travel distance. 


A more sophisticated strategy, the MCM strategy, derives its vector by rank ordering 
according to travel distance from each unit’s center of mass to the atom containing the call: 


Unit n is ith preferred if |x,’ — x;|+|y,’— y;| is the ith smallest travel distance. 

The MCM strategy includes information on the exact location of the call whereas the SCM 
strategy does not. Thus, we would expect that mean travel times would be highest for SCM, 
second highest for MCM, and lowest for AVL. 

Nine runs of the hypercube model were performed for each strategy: SCM, MCM and AVL, 
each run representing a different level of workload p. Here p= A/9p = A/9; it is important to 
note that since there are no lost calls p is identically equal to the average utilization factor 
(fraction of time busy) for units in the system. When each run was executed separately, the 
average cost per run using the M.I.T. IBM 370/168 computer was about $4.00 for the fixed 
preference strategies, $12.00 for the AVL strategy and $15.00 for both the AVL strategy and 
dispatch error probabilities with a non-AVL strategy (both AVL and non-AVL strategies being 
computed at the same time.) When four or more runs were executed together (implying only 
two tours of the hypercube), cost savings in excess of fifty percent were achieved. 


Mean travel time reduction vs p 

At a given value of p the mean travel time reduction caused by AVL dispatching is simply 
the difference between the region-wide travel time of the fixed preference strategy and that of 
the AVL strategy. Curves displaying mean travel time reductions for both SCM and MCM 
strategies are shown in Fig. 3. As one can see, the greatest travel time savings available from 
AVL occur for small values of p, when most units are available and the number of possible 
dispatching choices is large. For MCM dispatching, the mean travel time reduction decreases 
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Fig. 3. Mean travel time recuction vs p, nine-unit square region. 


monotonically with p whereas that for SCM dispatching is a unimodel function of p, reaching a 
maximum at about p=0.20. This unimodality is caused by the relatively high conditional 
dispatch error probability associated with a dispatch decision at small p, given that the district unit 
is busy (but because of small p, most near-by units are available); this high conditional error 
probability is caused by ignoring the call’s exact location, thereby often yielding ties in dispatch 
preferences where it is clear that one unit is more likely to be closer than another. Note that for both 
SCM and MCM the comparative advantage of AVL dispatching converges to zero as p converges 
to 1.0, a point at which there is virtually no choice allowed in selecting an available unit for dispatch. 


Probability of dispatch error vs p 

Similar curves of probability of dispatch error vs p are given in Fig. 4. Again, dispatch error 
tends to be high when p is small. Dispatch error is a monotonically decreasing function of p for 
MCM dispatching and a unimodal function for SCM dispatching. Note that at p = 0.0, for instance, 
approximately 28% of dispatch decisions could be improved (in the sense of smaller travel times) 
by employing AVL dispatching compared to either of the fixed preference dispatching strategies. 


Amount of interdistrict dispatching vs p 
AVL dispatching has its disadvantages as well as its advantages. One disadvantage is that 
the amount of interdistrict dispatching increases, thereby decreasing the amount of contact a 
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Fig. 4. Probability of dispatch error vs p, nine-unit square region. 
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server has with citizens in his “own” district. In police applications, where “district” is a police 
beat or sector, this is said to cause a loss of beat or sector “identity.” 

Curves indicating the extent of interdistrict dispatching for each of the three strategies are 
shown in Fig. 5. As expected for SCM and MCM strategies, the fraction F; of dispatches that 
are interdistrict dispatches almost equals p for small and moderate values of p. This is 
intuitively explained by the fact that a fraction p of calls for service find the district unit busy 
and thus require an out-of-district unit if immediate service is to be delivered. Also as expected, 
the fraction F; is significantly increased for low and moderate values of p by switching to AVL 
dispatching. For instance, F; at p ~ 0.0 is about 0.28, which is just what we expect since the 
dispatch error probability at p ~ 0.0 is about 0.28, thereby necessitating interdistrict dispatches 
for 28% of calls for service even when all units are available. 


Probability of dispatch error as a function of incident location 

Each of the previous three sets of curves had been derived earlier with a simulation model 
([4], Chaps. 6, 7]. However, the results reported here do not suffer from sampling error and they 
were generated at a cost at least an order of magnitude less than the simulation costs. 
Moreover, the hypercube model produces point-specific as well as area-averaged performance 
measures, something that is too expensive to obtain from a simulation model. 

An important consideration in the case of AVL dispatching, the point-specific dispatch error 
probability has heretofore been unobtainable. Computations of this quantity with the hypercube 
model have indicated that region-wide dispatch error probability can be rather modest, say 12%, 
yet specific atoms can have an associated dispatch error probability as high as 50% or more. 
This significant degree of spatial inhomogeneity in dispatch error probability is illustrated in 
Fig. 6, which displays for a fixed p (p = 0.1) this probability as a function of incident location x 
as one travels west to east at a y value fixed at y= 1.375. As can be seen from the figure, 
dispatch error probability increases sharply near the boundaries of districts, reflecting the fact 
that a unit on the other side of the boundary has a significant probability of being closest to the 
call. Thus AVL dispatching would yield the sharpest reduction :in travel times to incidents 
located near the borders of other districts. 


7. DISCUSSION 
The methods reported here for efficiently implementing AVL dispatching within the 
hypercube framework apply to a more general class of queuing system. In queuing terms, there 
are J classes of customers (corresponding to the J atoms), each class j arriving as an 
independent Poisson process to an M/M/N queue with distinguishable servers. Server n, if 
available, will be in posture i with probability J,; (s li = 1), And there is a cost 7, of assigning a 
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Fig. 5. Fraction of dispatches that are interdistrict vs p, nine-unit square region. 
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Fig. 6. Probability of dispatch error as a function of location of incident, nine-unit square region. 


server in posture i to a class j customer. The methods discussed in this paper allow one to 
model analytically (and solve numerically) the behavior of this system, operating under a policy 
that always assigns that server with minimum (immediate) cost. It should be noted, that in the 
spirit of the models of Carter, Chaiken and Ignall[8] and of Jarvis [9], that a server assignment 
policy that minimizes immediate cost does not in general minimize time-average cost of the 
system (although the difference between the two policies in system-wide mean cost has been 
found to be small—less than one percent when the cost has been travel time). In nonspatial 
applications one can imagine that customer classes could be defined by one or more of the 
following: yearly income, educational level, amount of cash carried, ethnicity, physical size, 
sex, or (in computer applications) type or source of data message. Too, a server's posture could 
be specified by any number of variables, including priority of his current activity (which is 
viewed as preemptable), degree of fatigue, amount of cash on hand, amount of core storage 
available. 
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APPENDIX:* NUMBER OF PROBABILITY COMPUTATIONS REQUIRED WITH THE 


BACKWARD REGENERATIVE UNIT-STEP TOUR 
The purpose of this appendix is to derive equation (9), which specifies the number of computations of q,414 required for 
a particular atom j in the course of touring the hypercube in a unit-step fashion (according to the backward regenerative 
tour), with units rank-ordered according to the L,’s: 


Lyj < Ley-ny <1 < Lay 
In the derivation we also require 
Oyj < Uw -ry << Oy 


We motivate the general result from the N = 4 unit problem which is summarized in Table A-1, whose columns contain 
(eft to right) the unit number, the number of state changes (or transitions) during a tour, the number of computations of 
Qna\z per transition, and the transition(s) at which that number of computations occur. Table A-2, summarizing the 
hypercube tour, contains the binary representations of the states in the tour, and a simple linear index denoting each state. 
We focus on state transitions and the number of computations required per transition. Since the computations of @nois 
must start at state S, (0000), we include “going to the start state” as a transition. Thus, there are 2” transitions for an N 
unit problem, with unit 2 experiencing 2"~" transitions (excepting unit N which experiences 2° + 1 = 2 transitions). 

We partition transitions into two classes: (1) those which involve a unit # for which L,, is the minimum of all L,’s 
currently in the available set #,; (2) all other transitions. For those in class 2, there is always at least one available unit that 
can be closer to atom j than unit n, regardless of the location of unit n; for those in class 1, unit n can be closest, 
regardless of the locations of the other available units. 


Table A-1. Summary of computational work required for an N =4 unit problem 


Unit Number of state Number of computations Transition at which 


number changes during tour per transition computations occur 
4 2 U,-L,+1 start up at state 1 
U,-L,+1 8-9 
3 2 (U,-L,4+1), 45 
U,-L,+1 12413 
2 4 (U,-L, +0), 243,637 
(U;-L,+1), 1415 
0 10311 
1 8 (U,-L, +), 1>2, 3-4, 5-56, 7-98 
(U,;-L,+)D, 13-414, 1516 
(U,-L,+), 910 
U,-L,+1 11912 


Table A-2. Unit-step tour of four-dimensional 


hypercube 
State S, of Index number k 
unit-step tour of state S, 
0000 1 
0001 2 
0011 3 
0010 4 
0110 5 
6111 6 
0101 7 
0100 8 
1100 9 
1101 10 
1111 ii 
1110 12 
1010 13 
1011 14 
1001 15 
1000 16 


__ *While this Appendix is self-contained, certain mathematical properties of the backward regenerative unit-step tour are 
invoked. Those wishing additional background in this area may wish to consuit{9}. 
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Consider first class 2 transitions. The transition from state S, to S, is of this type. Here unit 1 becomes busy while the 
other 3 units remain available. If there is any overlap in the table of 4,2. values, it occurs between the upper bound of 
unit 4 and the lower bound of unit 1. The amount of overlap is U,— L, + 1, if positive. Since the overlap is zero otherwise 
(implying 0 computations resulting from the 1-to-2 transition), we abbreviate the number of computations as (U,— L, + 1),, 
where (x), = x only if x > 0; otherwise (x), =0. Since there are 2%~'~'(=2/ = 4) transitions involving unit 1 while unit 4 is 
available, (U,— L, +1), computations are experienced 4 times. Similarly there are two transitions in which unit 1 changes 
state and unit 3 is available (while unit 4 is busy); each of these requires (U;— L, +1), computations. Once unit 1 makes a 
transition when units 4 and 3 are busy and unit 2 is available, requiring (U,—L,+ 1), computations. In general for an N 
unit problem, class 2 transitions of unit | require 


N 
> (U,-L,4),27"! 
n=2 


computations. The same reasoning applied to class 2 transitions of an arbitrary unit m yields for the number of 
computations 


N 
D (U,-L_ + ),27-"1. 


n=m+l 


Summing this last quantity over all m, we obtain the first term on the right hand side of equation (9). 

Now consider class 1 transitions and subdivide these into two subclasses: (a) those which result in the unit m becoming 
available; (b) those which result in unit m becoming busy. For an N unit problem, exactly one transition of type (1b) will 
occur for each unit N, N-2, N-4,..., and exactly one transition of type (1a) will occur for each unit N-1, N-3, N-5,...A 
(Ib) type transition must occur for unit N in transitioning from state S,»_, to Sgr-1,,, by construction of the tour which 
adds a “one” in position N at state Syv-1,,. Similarly such transitions must occur for all units m resulting from 
subtracting an even number from N, since at points in the tour which begin with the 2 highest indexed units busy (n 
integer), the tour for units 1, 2,..., (N —2n) has reversed an even number of times, yielding forward ‘‘subtours.” The 
length of each subtour is equal to the number of N-tour entries for which the 2n highest indexed units are busy. If the Nth 
digit switches to one only once in an N-digit tour, the nth digit must switch to one only once in an n-digit forward subtour. 
If units N, N-2, N-4, ... incur type (ib) transitions for an N-unit problem, the reversal of the transition sequence when 
unit N +1 is busy in an (N + 1)-unit problem indicates that those same units will experience type (1a) transitions in such a 
problem. Thus, units m obtained by subtracting an odd number from N each experience a type (1a) transition. 

For transitions of type 1(a) (resulting in unit m becoming the possibly closest unit), it is clear that the number of 
computations of 4,1, required is U,,—L,, +1. For transitions of type 1(b), unit m is no longer available. But, by the 
construction of the backward regenerative unit-step tour, unit m — 1 must also be unavailable (since the transition from 0 to 
1 for unit m follows 2"~? consecutive states in which unit m —1 is busy). Also by the construction of the tour, unit m-3 
must be free when unit m makes its type 1(a) transition. This is so since the tour has stepped backward to state S,, picking 
up all zeroes except for unit m-1 at the point of unit m’s transition to busy status. Thus, if we do not count erasing zeroes 
in positions L,— L, as computations, then the number of computations required as a result of unit m making a type 1(b) 
transition is Um.2—- Lm.2+ 1 (since unit m-2 is now the possibly closest unit). 

In the N =4 example, the transition 8->9 is of type I(b), causing unit 4 to become busy and requiring U,- L,+1 
computations. Unit 2’s transition 10> 11 is also of this type, yielding the state 1111, implying that all units are busy; here 
no ordinary computations are required and our formula is still valid since U,,.>— Ly». + 1 is not defined for U, and Lo. 

Finally, since we include the starting state as a transition, we must add Uy — Ly +1 as the number of computations 
required to start the process. Adding all computations required for type (1a) and (1b) transitions and for the starting state, 
we obtain the second term on the right hand side of equation (9), and our derivation is complete. 


